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Abstract In this paper, with the notion of independent identically distributed (IID) 
random variables under sub-linear expectations initiated by Peng, we investigate a law of 
■ the iterated logarithm for capacities. It turns out that our theorem is a natural extension 

of the Kolmogorov and the Hartman-Wintner laws of the iterated logarithm. 
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Introduction 

> 

. The classical laws of the iterated logarithm (LIL) as fundamental limit theorems in prob- 

0> ! ability theory play an important role in the development of probability theory and its 

applications. The original statement of the law of the iterated logarithm obtained by 
Khinchine (1924) is for a class of Bernoulli random variables. Kolmogorov (1929) and 
Hartman-Wintner (1941) extended Khinchine's result to large classes of independent ran- 
dom variables. Levy (1937) extended Khinchine's result to martingales, an important 
class of dependent random variables; Strassen (1964) extended Hartman-Wintner's result 
^ I to large classes of functional random variables. After that, the research activity of LIL 

has enjoyed both a rich classical period and a modern resurgence ( see. Stout 1974 for de- 
tails). To extend the LIL, a lot of fairly neat methods have been found (see, for example, 
De Acosta 1983), however, the key in the proofs of LIL is the additivity of the proba- 
bilities and the expectations. In practice, such additivity assumption is not feasible in 
many areas of applications because the uncertainty phenomena can not be modeled using 
additive probabilities or additive expectations. As an alternative to the traditional prob- 
ability/expectation, capacities or nonlinear probabilities/expectations have been studied 
in many fields such as statistics, finance and economics. In statistics, capacities have 
been applied in robust statistics (Huber,1981). For example, under the assumption of 
2-alternating capacity, Huber and Strassen (1973) have generalized the Neyman-Pearson 
lemma. Similarly Wasserman and Kadane (1990) have generalized the Bayes theorem for 
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capacities. It is well-known that, in finance, an important question is how to calculate the 
price of contingent claims. The famous Black- Shores 's formula states that, if a market is 
complete and self-financial, then there exists a neutral probability measure P such that 
the pricing of any discounted contingent claim ^ in this market is given by £^p[C]- In this 
case, by Kolmogorov's strong law of large number and LIL, one can obtain the estimates 
of the mean n :— Ep[^] and the variance cr^ := Ep[\^ — /x^] with probabihty one by 

II— lim —Sn, 0" = limsup(2nloglogn)~^/^|S'„ — 

n^oo n n^oo 

where Sn is the sum of the first n of a sample {Xj} with mean /i and variance cr^. Statisti- 
cally, an important feature of strong LLN and LIL is to provide a frequentist perspective 
for mean /i and standard variance a. However, if the market is incomplete, such a neutral 
probability measure is no longer unique, it is a set V of probability measures. In that 
case, one can give sub-hedge pricing and super-hedge pricing by £[^] :— mi^Egl^] and 

E[^] :— sup i?Q[C]- Obviously, both £[■] and E[-] as functional operators of random vari- 

ables are nonlinear. Statistically, how to calculate sub-super hedge pricing is of interest. 

Motivated by sub-hedge and super-hedge pricing and model uncertainty in finance, Peng 
(2006-2009) initiated the notion of IID random variables and the definition of G-normal 
distribution. He further obtained new central limit theorems (CLT) under sub-linear ex- 
pectations. Chen (2009) also obtained strong laws of large numbers in this framework. 
A natural question is the following: Can the classical LIL be generahzed for capacities? 
In this paper, adapting the Peng's IID notion and applying Peng's CLT under sub-linear 
expectations, we investigate LIL for capacities. Our result shows that in the nonaddi- 
tive setting, the supremum limit points of {(2nloglogn)^"'^/^|S'„|}„>3 lie, with probability 
(capacity) one, between the lower and upper standard variances, the others lie, with 
probability (capacity) one, between zero and the lower standard variance. This becomes 
the Kolmogorov and the Hartman-Wintner law of the iterated logarithm if capacity is 
additive, since in this case lower and upper variances coincide. 



2 Notations and Lemmas 

In this section, we introduce some basic notations and lemmas. For a given set V of 
multiple prior probability measures on {Q,J^), let H be the set of random variables on 
(Q,J-). 

For any ^ e "H, we define a pair of so-called maximum- minimum expectations (E, E) 

by 

E[e]:=supEp[e], inf^p[e]. 
pg-p Pep 

Without confusion, here and in the sequel, Ep[-] denotes the classical expectation under 
probability measure P. We use E[-] to denote supremum expectation over V. 
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Let ^ — Ia ior A & immediately, a pair (V, v) of capacities is given by 
Y{A) := sup P{A), v{A) := inf P{A), VA e J^. 

Obviously, E is a sub-linear expectation in the sense that 

Definition 1 A functional E on i— )■ (—00, +00) is called a sub-linear expectation, if it 
satisfies the following properties: for all X,Y & l-L, 

(a) Monotonicity: X >Y implies E[X] >E[Y]. 

(b) Constant preserving: E[c] = c, Vc G M. 

(c) Sub-additivity: E[X + ¥]< E[X] + E[Y]. 

(d) Positive homogeneity: E[XX] = XE[X], VA > 0. 

Remark Artzner, Delbaen, Eber and Heath (1997) showed that a sub-linear expectation 
indeed is a supremum expectation. That is, if E is a sub-linear expectation on "H; then 
there exists a set (say V) of probability measures such that 

E[^] = sup Ep[^], -E[-^] = inf Ep[^]. 
P^f Pev 

Moreover, a sub-linear expectation E can generate a pair (V, v) of capacities denoted by 

V(^):=E[7^], ^(^) := -E[-7^], ^AeT. 

Therefore, without confusion, we sometimes call the supremum expectation as the sub- 
linear expectation. 

It is easy to check that the pair of capacities satisfies 

V(^) + viA"") = 1, yAeJ" 

where A'^ is the complement set of A. 

For ease of exposition, in this paper, we suppose that V and v are continuous in the 
sense that 

Definition 2 A set function V: T ^ [0, 1] is called a continuous capacity if it satisfies 

(1) v{cf>) = 0, v{n) = 1. 

(2) V{A) < V{B), whenever A G B and A, B e T. 

(3) V{An)tV{A),if A„tA 

(4) V{Ar,) iV{A), if A„ i A, where A^,AeJ^. 
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The following is the notion of IID random variables under sub-linear expectations in- 
troduced by Peng [El [H [H [151 HE] . 

Definition 3 (IID under sublinear expectations/capacities) 

Independence: Suppose that Yi,Y2,--- , y„ is a sequence of random variables such that 
Yi G "H. Random variable y„ is said to be independent of X := (Yi, ■ ■ ■ , F„_i) under 
E, if for each measurable function ip on M" with f{X, F„) G "H and ip{x, F„) G Ti for 
each X G M"^"*^, we have 

E[^{X,Y„)]=E[ip{X)], 
where (p(x) := E[y9(x,y„)] and ^(X) G Ti. 

Identical distribution: Random variables X and Y are said to be identically dis- 
tributed, denoted hj X = Y, if for each measurable function ip such that ^fiX), (p{Y) G 

ElifiX)] = EiifiY)]. 

IID random variables: A sequence of random variables {Xi}°l^ is said to be IID, if 
Xi = Xi and Xj+i is independent of Y := (Xi, ■ ■ ■ , Xi) for each i > 1. 

Pairwise independence: Random variable X is said to be pairwise independent to Y 
under capacity V, if for all subsets D and G G 

V{X eD,Y eG) = V{X G D)V{Y G G). 

The following lemma shows the relation between Peng's independence and pairwise 
independence. 

Lemma 1 Suppose that X, F G "H are two random variables. E is a sub-linear expectation 
and (V, v) is the pair of capacities generated by E. If random variable X is independent 
of Y under E, then X also is pairwise independent of Y under capacities V and v. 

Proof If we choose ip{x,y) = Ij:,{x)lG{y) for E, by the definition of Peng's independence, 
it is easy to obtain 

V(X eD,Y eG) = V(X G D)ViY G G). 
Similarly, if we choose ip{x,y) = —lD{x)lG{y) for E, it is easy to obtain 

v{X e D,Y e G) = v{X e D)v{Y g G). 

The proof is complete. 

Borel-Cantelli Lemma is still true for capacity under some assumptions. 

Lemma 2 Let {A^, n > 1} be a sequence of events in J-" and (V, v) be a pair of capacities 
generated by sub-linear expectation E. 
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(1) If y: n^n) < oo, then V n u A = 0. 

n=l \7i=lj=n / 

(2) Suppose that {An,n > 1} are pairwise independent with respect to V , i.e., 

/ oo \ oo 



\i=l I 4 = 1 



If ^ 'y(^n) = oo, then 



n=\ 



oo oo 



V 



V,n=l i=n 



Proof 



< v( n u 

n=l i—n 
oo 

< v(U^^) 

i=n 

oo 

< ^0, as n ^ oo. 

i=n 

The proof of (1) is complete. 

oo oo 

< 1-vif] [JA,] 

n=l i=n 

oo 

= 1- lim t;(U A,) 

oo 

= \\m[l-v{[jAi)] 

i=n 

oo 

= lim V( n 

n^'^ i=n 
oo 

= lim Y[^{Ai) 

i=n 
oo 

= lim n(i-^(^i)) 

oo 

< lim Yl ^^p{~v{Ai)) 

i=n 

oo 

= lim exp(— Yj "^(A)) = 0- 

i=n 

We complete the proof of (2). 

Definition 4 (G-normal distribution, see Definition 10 in Peng Given a sub-linear 
expectation E, a random variable ^ G with 
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is called a G-normal distribution, denoted by A/'(0; [£^,0"^]), if for any bounded Lipschtiz 
function 0, writting u(t,x) := E[</)(x + y/t^)], {t,x) G [0, oo) x M, then u is the viscosity 
solution of PDE: 

dtu - G{dl^u) = 0, u{0, x) = 
where G{x) := — and x+ := max{x,0}, x~ := {—x)~^. 

The following lemma can be found in Denis, Hu and Peng 

Lemma 3 Suppose that ^ is G-normal distributed by Af{0; [g^,o''^])- Let P be a probabil- 
ity measure and be a bounded continuous function. If {Bt}t>o is a P-Brownian motion, 
then 



E[0(e)] = supEp 

6»ee 







, f[0(O] = inf^p 



OgdBs 







where 

:= {{6'f}f>o : 6t is J-^-adaped process such that o_< 6t <o'} , 
Tt '■= cr{Bs, < s < t} V Af, N is the collection of P-null subsets. 
For the sake of completeness, the sketched proof of Lemma 3 is given in Appendix A. 

With the notion of IID under sub-linear expectations, Peng shows the central limit 
theorem under sub-linear expectations (see Theorem 5.1 in Peng [15]). 

Lemma 4 (Central limit theorem under sub-linear expectations) Let {Xi]fl^ be 
a sequence of IID random variables. We further assume that 

E[Xi] =£[Xi] = 0. 

Then the sequence {Sn}'^=i defined by 

- 1 " 

converges in law to ^, i.e., 

hm E[<^(5„)]=E[v9(0], 

n— >oo 

for any continuous function (p satisfying the linear growth condition, where ^ is a G-normal 
distribution. 

Remark 1 Suppose that E[X^] = a^, a > and is a convex function, then, we have, 
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3 Main results 

In this section, we will prove the following LIL for capacities: 

Theorem 1 Let {Xn}'^=i be a sequence of bounded IID random variables for sub-linear 
expectation E with zero means and bounded variances, i.e., 

(A.l) E[X,]=S[X,] = 0, 

(A.2) E[Xf] = a^, S[Xf] = a^, where < a < a < oo. 



Denote Sn = ^ Xi. Then 

i=l 

(I) 

V [ a< limsup " = <a] =1. 
V n-^.oo y/2n[og\ogn ) 

(11) 

< lim inf " < —q_ 

n^oo i/2nloglogn 

(III) Suppose that C({x„}) is the cluster set of a sequence of in M, then 

V ( C (I " 1 ) \ 1 lim sup . — , lim inf " ^=1 = {—a, a 



■\ —^^^=^^= f \ \s nmsup , nmim —^^^=^^= 

^ { \/2n[og\ogn ) J { n-^oo \f2n\og\ogn n-^oo ^2nloglogn 

In order to prove Theorem 1, we need the following lemmas. 

Lemma 5 Suppose ^ is distributed to G normal A/'(0; [ct^,^^]), where < a < a < oo. 
Let be a bounded continuous function. Furthermore, if is a positively even function, 
then, for any 6 e M, 

e-^Sm)]<Sm-b)]. 

Proof Let P be a probabihty measure, {-Bt}t>o be a P-Brownian motion. Since ^ is 
distributed to G-normal, by Lemma 3, we have 



OgdBs 







For any E write Bt := Bt — /g ^cis. By Girsanov's theorem, {Bt}t>o is a Q- 
Brownian motion under Q denoted by 



dP ■ 
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That is 



Thus 



dP 
dQ 



Ep 
Ep 



Q 



(^ABt - /o j-ds) 



L OgdBs 



(/o &sdB,) 



(1) 



We now prove that if (f) is even, then 

-1 



E, 



Q 







>E, 



Q 



OgdBg 



In fact, let Bt := — -Bt, then {Bt}t>Q is also a Q-Brownian motion. Note that the assump- 
tion that function <p is even, therefore 



Er 



Eq 
Eq 
Eq 



So IdB. 



bmce ^ > 1, we have 



Er 



e^dB,) 



- Jo j:<^^= 



> Er 



'<t> [j^esdBs) 



)] 



From (1), we have 



£:U(^ - 6)1 = inf Ep 



> e-|(^/^)^inf£;Q 



e-hW-f inf Ep 

^[0(0]- 



^ OsdBg 



The proof of Lemma 5 is complete. 



Lemma 6 Under the assumptions of Theorem 1, then, for each r > 2, there exists a 
positive constant Kj. such that 



E[max < KrU^^ for all m > 0, 
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where S. 



m+n 
i=m+l 



Proof. First, we prove that there exists a positive constant Cr such that 

sup E|S'm^„|'' < CrU^- 
m>0 



(2) 



By Lemma 4 and Remark 1, it is easy to check that 

1 



hm E[\Sm,n/V^n = E[ 



\y\ 6xp 



So, we can choose 



\y\ exp 



2a' 



dy < oo. 



2a^ 



then there exists hq such that > hq, 

Note that {X„}^j^ is a bounded sequence, then there exists a constant M > 0, such 
that, for each n, < M. So we can obtain (2) holds. Hence, in a manner similar to 
Theorem 3.7.5 of Stout [I?], we can obtain 

E[max |S'm„jr] < KrU^ for all m > 0. 

i<n ' 

Lemma 7 Under the assumptions of Theorem 1, if 



V I limsup 



then, for any 6 G M satisfying \b\ < a, 



V I liminf 

n—¥oo 



y/2n\og\ogn 



< 



a 



y/2n\og\ogn 

Proof We only need to prove that for any e > 0, 

V ( lim inf ' 



v^2nloglogn 



< e 



To do so, we only need to prove that there exists an increasing subsequence {n^} of {n} 
such that 



fl U {|^„„/v/2nfcloglognfc - b\ < e} ] = 1. 

\m=l k=Tn / 

Indeed, let us choose Uk := for k > 1. For each t > 0, write 

Nk := [{rik+i - nfc)V/2nfc+iloglognfe+i], 



(3) 
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mfe := [2njt+iloglognfe+i/i^(njk+i - n^)], 
Tk := ^y2nk+lloglognk+l/tmk. 

Since {X^jJ^i is a sequence of IID random variables under sub-linear expectation E, we 
have 



^2ni,+iloglognfc+i 



<e] = v{b-e< , ""'=+1-'' <b + e 

y 2nfe+iloglognfc+i 

<b + e/2] -v (-e/2 < ^7+1 -'^'^^fe-'^ < e/2 

\ v2nfc+iloglognfc+i 



> v(b-e/2< . 

y -^2nfc+iloglognfc+ 

> V (trukib - e/2) < < tmk{b + e/2) ]-v[ -e/2 < 

> (v(bt-e 



^2?ifc+iloglognfc+i 



< e/2 



(^^; - et/2 < ^ < bt + et/2))"' • ^; (^-e/2 < ^T'^'Zl"^' ^ 



-^2nfc+iloglognfc+i 



where is a even function defined by 

1 _ el^l-^*/2^ 



(4) 



0, 



< et/2; 
\x\ > et/2. 



Note the fact that ^ 00, as /c — >■ 00 and applying Lemmas 4 and 5, 



log£[0(5jv,/rfe - ^ log£[0(e - > + log£[0(e)], as A; ^ 00. 

log {£[(t){SNk/rk - • (rifc+i - nfc)/2nfe+iloglognfe+i 

= {nk+i - nfc)/2nfe+iloglognfc+i ■ mk\og£[(j){SNt,/rk - ht)] 
^ t-HogSm - bt)] > -l{b/af + t-HogS[m]- 



Thus 



However, 



liminfrMog£:[(/)(e-6t)] > --{b/af 

c— >-oo Z 



(5) 



(6) 



So, from (5) and (6), we have, for any 5 > and large enough t, 



lim log{£[(l>{SNjrk - bt)]r' ■ {uk+i - Uk) /2nk+iloglognk+i > --{\b\/a + S/2f. (7) 
On the other hand, by Chebyshev's inequality. 



V 



"■k+i-rik-Nknik 



^2nfc+iloglognfc+i 



> e/2 < 2{nk+i-nk-Nkmk)a /e nfe+iloglogrifc+i ^0, as A; ^ 00. 
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So, as A; — >■ oo, 



(n»,, - nj /2«.+,loglog«.« • log. (-./2 < ^g^^ < eft) 



= {uk+i - nfc)/2nfc+iloglognfc+i • log |^1 - V 
Therefore, from (4), (7) and (8), we have 



'S'nj. + i-rn.-JVj. 



-^271^+1 loglogrifc+i 



> e/2 ^ 



(8) 



hminf {uk+i - Uk) /2njfc+iloglognfe+rlogv 



fe— >oo 



^2nfc+iloglognfc+i 



<e]> --{\b\/a+5/2r. 



Now we choose 6 > such that \b/a\ +S < 1. Then, for given 5 > 0, there exists ko such 
that yk > ko, 



< e 



> exp {-2nfe+iloglognfc+i/ {uk+i - Uk) ■ {{\h/q_\ + 5) /2)} 
~ exp(-(|6/a| + 5)loglognfc+i). 



Thus 



k=l 



Q _ Q 



A/2nfe+iloglognfc 



+1 



< e = oo. 



Using the second Borel-Cantelh Lemma, we have 



hm inf 



q _ Q 



V2njtloglognfe 



< e, a.s. i'. 



But 



< 



VSrifcloglogrifc 
Note the following fact 

and 



'i — 'i 



x/2nfeloglognfe 



+ 



1^, 



"fc-i I 



^2nfe_iloglog 



rik 



v/2nfc_iloglognfc_i y2n^IogIogn^ 
— )■ 0, as k ^ oo 



■ (9) 



limsup I S'„ I / a/ 2nloglogn < cr, a.s. v. 

n->oo 

Hence, from inequality (9), for any e > 0, 



lim inf 

fe->oo 



therefore. 



V I lim inf 

n— >-oo 



V2nfcloglognfc 



< e, a.s. V, 



-\/2nloglogn 



-b 



< e 
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Since e is arbitrary, we have 



V I liminf 



-\/2nloglogn 
We complete the proof of Lemma 7. 



-b 



The Proof of Theorem 1 (I) First, we prove that 

Sn, 



V I hm sup 



< a 



Ay/2nloglogn 

For each e > and A > 0, by Markov's inequahty, 

V (v^nfe > (1 + ^)^) = V(^>(l + 6)v/2b^j 

< exp(-2(l + e)2Aloglogn)E 



(10) 



On the other hand, by Lemma 4 and Remark 1, we have, if A < |, 

2M I r°° { 



hm E 

n— >-oo 



cxp A 



Fixing /3 > 1, for each e > 0, we can choose A^ e (0, |) such that ^ = 2(1 + e)^Ag > 1. So, 
we can choose 



Ce>^ 

then there exists no such that Vn > no. 



exp (Aey^) exp ( -y ) d?/. 



exp Ae 



(11) 



From (10) and (11), we can obtain, Vn > no, 

Sn 



V 



> (l + e)a) < Ceexp(-^loglogn). 



_\/2nloglogn 

Choose < q; < 1 such that a/3 > 1. Let n^ := [e*^'^] for A; > 1. Then 



V2nfcloglognjk 



> 



■a/3 



< OO, 



nk>no \ V fv o o A. / nk>no 

where is a positive constant. By the first Borel-Cantelh Lemma, we can get 

/ ^ \ II Q 



V n I J ) >(l + 6)a 

UJiHlV2r^.loglogn. 
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Also 

V ( limsup "fc < (1 + e)a ) = 1. 

V k^oo v2nk\og\ognk J 

Let Mk := max ,f"~^r''' for A; > 1. For each k > 1, 



V2nloglogn \/2nfcloglognfc \/2nloglogn \/2nloglogn ' 

for Uk < n < rik+i- For given a, we choose p > 2 such that p(l — a) > 2. By Lemma 6, 
we get 

OO OO / \P oo 

^ fc? (2iitloglogiii)« 

where D'^ is a positive constant. From (12) and by Chebyshev's inequahty, for each e > 0, 

k=l k=l 

Hence, by the first Borel-CanteUi Lemma again, 

V I hmsupMfc < e J = 1- 

Since e is arbitrary, we have 

V (\im Mfe = = 1. 

Noting that 

V2nfeloglognfc 

— )• 1, as A; — >■ oo. 



v/2nfc+iloglognfc+i 
we have 

S " ({lin-.p < (1 + ep} n { Ita M» = O}) 



V ( hmsup —==^== < a ] =1. (13) 



= 1, 

which imphes 

1) I lim Sim 

-\/2nloglogn 

Similarly, considering the sequence {—Xn}'^^n it suffices to obtain 

V (limsup . = <a)—l. 
\ n-^oo y/2n[og\ogn J 
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V ( lim inf " 

^■oo ^2nloglogn 



> -a = 1 



Now we prove that 



V ( lim sup . " = 
n^-oo V2n[og\ogn 



> (J = 1. 



Indeed, from (13) and (14), it is easy to obtain 

V (lim sup ^ = 

\ n-^oo vS'T'loglogn 



< a 



For any number b e (0, ct), noting the fact that |6| < a, by Lemma 7, we 



V I lim inf 

n->oo 



which implies that 



-\/2nloglogn 

V ( lim sup = 
n-^oo v2?T'loglogn 







> (J = 1. 



< a = 1. 



So, from (13) and (15), we can obtain 

V ( a< lim sup = 
\ n^oo v2wloglogn 

The proof of (I) is complete. 

(II) Considering the sequence {— by (I), it suffices to obtain 



V [ a< lim sup . " = 
n-^oo yS'T'loglogn 



< a = 1. 



Thus 



V ( —a < lim inf " 

n-^oo -^2nloglogn 



< -a = 1. 



To prove (III). We only need to prove that for any number b e (— o;,ct) 



V I lim inf 

n— >-oo 



Sn 



-b 







i/2nloglogn 

Noting the fact that \b\ < a, by Lemma 7, we can easily obtain (16). 
The proof of (III) is complete. 
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